Symmetries of Symmetry Breaking Constraints 



George Katsirelos^ and Toby Walsh^ 



o 



oo 
(N 



< 
o 



> 

o 

vn 

o 
o 



X 



Abstract. Symmetry is an important feature of many constraint pro- 
grams. We show tiiat any problem symmetry acting on a set of sym- 
metry breaking constraints can be used to break symmetry. Different 
symmetries pick out different solutions in each symmetry class. This 
simple but powerful idea can be used in a number of different ways. 
We describe one application within model restarts, a search technique 
designed to reduce the conflict between symmetry breaking and the 
branching heuristic. In model restarts, we restart search periodically 
with a random symmetry of the symmetry breaking constraints. Ex- 
perimental results show that this synmietry breaking technique is ef- 
fective in practice on some standard benchmark problems. 

1 INTRODUCTION 

Symmetry occurs in many real world problems. For instance, cer- 
tain machines in a scheduling problem might be identical. If we have 
a valid schedule, we can permute these machines and still have a 
valid schedule. We typically need to factor such symmetry out of 
the search space to be able to find solutions efficiently. One popu- 
lar way to deal with symmetry is to add constraints which eliminate 
symmetric solutions (see, for instance, 1 151 1 181 141 114111911211 ). Such 
symmetry breaking is usually simple to implement |5, 6| and is of- 
ten highly efficient and effective in practice. Even for problems with 
many symmetries, a small number of symmetry breaking constraints 
can often eliminate much or all of the symmetry. But where do such 
symmetry breaking constraints come from? We show here that we 
can apply symmetry to symmetry breaking constraints themselves to 
generate potentially new symmetry breaking constraints. 

There are a number of applications of this simple but powerful 
idea. We give one application in the area of restart based methods. 
Restarting has proven a powerful technique to deal with branching 
mistakes in backtracking search |9|. One problem with posting sym- 
metry breaking constraints is that they pick out particular solutions in 
each symmetry class, and branching heuristics may conflict with this 
choice. Model restarts is a technique to deal with this conflict flOl. 
We periodically restart search with a new model containing differ- 
ent symmetry breaking constraints. Our idea of applying symmetry 
to symmetry breaking constraints provides a systematic method to 
generate different symmetry breaking constraints to be used within 
model restarts. Different symmetries pick out different solutions in 
each symmetry class. Restarting search with a different symmetry of 
the symmetry breaking constraints may therefore permit symmetry 
breaking constraints to be posted that do not conflict with the branch- 
ing heuristic. Our experimental results show that model restarts is in- 
deed effective at reducing the conflict between branching heuristics 
and symmetry breaking. 
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2 SYMMETRY 

We consider two common types of symmetry (see [JJ for more dis- 
cussion). A variable symmetry is a permutation of the variables that 
preserves solutions. Formally, a variable symmetry is a bijection a 
on the indices of variables such that if Xi — di, . . . , X„ = d„is a 



solution then X, 



a(l) 



di, 



,X, 



cr(n) 



d„ is also. A value symme- 



try is a permutation of the values that preserves solutions. Formally, 
a value symmetry is a bijection 9 on the values such that if Xi = 
di, . . . , Xn = d„ is a solution then Xi — 9(d\), . . . , X„ = 9{dn) 
is also. In |T7j, these are called global value symmetries as their ac- 
tion on values is the same for all variables. Symmetries can more 
generally act on both variables and values. Our results apply also to 
such symmetries. As the inverse of a symmetry and the identity are 
symmetries, the set of symmetries forms a group under composition. 
We will use a simple running example which has a small number 
of symmetries. This example will demonstrate that we can use sym- 
metry itself to pick out different solutions in each symmetry class. 

Running Example. A magic square is a labelling of a nby n square 
with the numbers 1 to n so that the sums of each row, column and 
diagonal are equal (prob019 in CSPLib fWl). The most-perfect magic 
square problem is to find a magic square in which every 2 by 2 square 
has the same sum, and in which all pairs of integers n/2 apart on 
either diagonal have the same sum. We model this as a CSP with 
Xij = k iff the square {i,j) contains k. One solution for n = 4 is: 



(1) 



This is one of the oldest known most-perfect magic squares, dating 
from a 10th century temple engraving in Khajuraho, India. 

This problem has several symmetries. First, there are the 8 symme- 
tries of the square: the identity mapping, the rotations 90° clockwise, 
180° and 270° , and the reflections in the vertical, horizontal and di- 
agonal axes. For example, applying the symmetry o"„ that reflects the 
square in its vertical axis to (J} gives a symmetric solution: 
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(2) 



The problem also has a value symmetry 9i„v that inverts values, 
mapping i onto n + 1 — i. For instance, applying 9inv to 0, gen- 
erates another symmetric solution: 
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(3) 
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We can also combine the value and variable symmetries. For ex- 
ample, if we apply the composition of the last two symmetries (that 
is, 6inv o o-u) to Q, we reflect the solution in the vertical axis and 
invert all values giving another symmetric solution: 



(4) 



Note that is itself the reflection of Q in the vertical axis. The 
problem thus has 16 symmetries in total. Jit 

3 SYMMETRY BREAKING 

One common way to deal with symmetry is to add constraints to 
eliminate symmetric solutions 1151 . We shall show that we can in 
fact break symmetry by posting a symmetry of any such symmetry 
breaking constraints. 

Running Example. Consider again the most-perfect magic square 
problem. To eliminate the symmetries of the square, we can post the 
constraints: 



Xi,i < min(Xi,„,X„,i,X„ 



X\,n < Xri 



(5) 



These ensure that the smallest corner is top left, and the bottom left 
corner is smaller than the top right. This eliminates all degrees of 
freedom to rotate and reflect the square. Note that \5^ eliminates so- 
lutions ([7J and but leaves their reflections ^ and 0. 

To eliminate the value symmetry 6inv and any rotations or reflec- 
tions of it, we can post: 



^1,1 < n^ + 1 -max(Xi,i,Xi,„,X„,i,X„,„) 



(6) 



This ensures that the smallest corner in the magic square is smaller 
than the smallest corner in any rotation or reflection of the inversion 
of the solution. Note that the smallest corner cannot equal the inver- 
sion of any corner since the problem constraints of a most-perfect 
magic square ensure that the inversion of any corner lies inside the 
square (in fact, on the diagonal). This symmetry breaking constraint 
eliminates but leaves @. Thus, of the four symmetric solutions 
given earlier, only (jj} satisfies (O and ddj. X 

One of our main observations is that any symmetry acting on a 
set of symmetry breaking constraints will itself break the symme- 
try in a problem. Different symmetries pick out different solutions in 
each symmetry class. To show this, we need to consider the action 
of a symmetry on a set of symmetry breaking constraints. Symmetry 
is often defined as acting on assignments, mapping solutions to so- 
lutions. We need to lift this definition to constraints. The action of a 
variable symmetry on a constraint changes the variables on which the 
constraint acts. More precisely, a variable symmetry a applied to the 
constraint C{Xj, . . . ,Xh) gives C{X„(^j), . . . ,X^(i^^). The action 
of a value symmetry is also easy to compute. A value symmetry 9 ap- 
plied to the constraint C{Xj,. . . , Xk) gives C{9{Xj), ..., 9{Xk)). 

Running Example. To illustrate how we can break symmetry with 
the symmetry of a set of symmetry breaking constraints, we shall con- 
struct symmetries o/lO and ^. 

Consider the symmetry av that reflects the square in the vertical 
axis mapping Xi_i onto X„,i (and vice versa), and Xi,„ onto X„,„ 
(and vice versa). If we apply a^ to jj)) we get: 



These new symmetry breaking constraints ensure that the smallest 
corner is now top right, and the bottom right corner is smaller than 
the top left. This again eliminates all degrees of freedom to rotate and 
reflect the square. Note that fZl) eliminates solutions (|2| and Q but 
leaves ([7J and (0. This is the opposite of posting which would 
leave ^ and ^, but eliminate and Q. 

If we apply o^ to ^, we again get a constraint that breaks the 
value symmetry 9inv and any rotations or reflections of it: 



X„,i < n^ + 1 - max(X,i,i,X„,„,Xi,i,Xi 



(8) 



This again ensures that the smallest corner in the magic square is 
smaller than the smallest corner in any rotation or reflection of the 
inversion of the solution. This eliminates but leaves 0. Thus, 
of the four symmetric solutions given earlier, only satisfles the 
symmetry a^ o/0 and 0. 

We can also break symmetry with any other symmetry of the sym- 
metry breaking constraints. For instance, if we apply 9inv ° o"t) to 
we get the constraints: 



+ 1 - X„,i < min(n^ + 1 - X, 



n^ + l 



X„ 



n,n,n + 1 — Xi,i, ri 
< n^ + 1 - Xi,i 



+ 1 - Xi, 



Xn,i < min(X„^„, Xi^i, Xi,„ 



Xn.n < X\ 



(7) 



These simplify to: 

Xn,i > max(X„,„,Xi,i,Xi,„) 

Xn,n > X\^\ 

Similarly, if we apply 9inv ° o^ to we get the constraint: 

Xn,\ > n^ + 1 - min(X„,i,X„,„,Xi,i,Xi,„) 

The three constraints ensure that the largest corner is top right, the 
bottom right is larger than the top left, and the largest corner is 
larger than the largest comer in any rotation or reflection of the in- 
version of the solution. This again prevents us from rotating, reflect- 
ing or inverting any solution. Of the four symmetric solutions given 
earlier, only satisfles 9inv ° o"„ o/0 and 0. We see therefore 
that different symmetries of the symmetry breaking constraints pick 
out different solutions in each symmetry class. Jft 

4 THEORETICAL RESULTS 

The running example illustrates that we can break symmetry with a 
symmetry of a set of symmetry breaking constraints. We will prove 
that this holds in general. Our aim is to show: 

Any symmetry acting on a set of symmetry breaking constraints 
itself breaks symmetry. Different symmetries pick out different 
solutions in each symmetry class. 

We will consider the action of a symmetry on the solutions and sym- 
metries of a set of symmetry breaking constraints. We will also study 
the action of a symmetry on the soundness and completeness of a set 
of symmetry breaking constraints, the representative solutions picked 
out by the symmetry breaking constraints and the symmetries that are 
eliminated. Finally we will consider what symmetries can be found 
within a set of symmetry breaking constraints. 

4.1 Symmetry and satisfiability 

We start with the action of a symmetry on the satisfiability of a set 
of constraints. This simple result is used in some of the later proofs. 
We write (7{C) for the result of applying the symmetry a to the set 
of constraints C. 



Proposition 1. For any symmetry a, a set of constraints C is satisfi- 
able ijf cj{C) is satisfiable. 

Proof: Suppose C is satisfiable. Then there exists a satisfying as- 
signment A of C By considering the action of a symmetry on a set 
of constraints, we can see that (j[A) satisfies o-{C). Thus cr(C) is 
satisfiable. The proof reverses easily. D 

4.2 Symmetry and solutions 

We next consider the action of a symmetry on the solutions of a set of 
(possibly symmetry breaking) constraints. We write sol{C) for the 
set of solutions to the set of constraints C. 

Proposition 2. For any symmetry a and set of constraints C: 

sol{a{C)) = a{sol{C)) 

Proof: Consider any solution A G sol{a{C)). We view a solution as 
a set of assignments. Then a{C)uA is satisfiable. As a is a bijection, 
there exists a unique B such that A — o{B). Thus (t(C) U o-{B) is 
satisfiable. Hence ct(C U B) is satisfiable. By Proposition[T] C U B 
is satisfiable. That is, B € sol{C). Thus a-{B) £ a{sol{C)). Hence 
A G a{sol{C)). The proof reverses directly. □ 

On the other hand, if we apply a symmetry to a set of constraints 
with that same symmetry, we do not change the set of solutions. 

Proposition 3. If a is a symmetry of a set of constraints C then 

sol{C) = a{sol{C)) 

Proof: Consider any A £ (t(soZ(C)). Then there exists _B £ sol{C) 
such that A = cr{B). Since cr is a symmetry of C, cr{B) G sol(C). 
That is A £ sol{C). The proof reverses directly. □ 

4.3 Symmetries under symmetry 

The action of a symmetry on a set of constraints also does not change 
the symmetries of those constraints. 

Proposition 4. /f E is a symmetry group of a set of constraints C 
then S is also a symmetry group of ij{C) for any a G E. 

Proof: Consider any solution A of cr(C) and any r G E. Since 
0- G E, by Proposition [3] sol{a{C)) = sol{C). Thus A G sol{C). 
As r G E, t{A) G sol{C). Hence t{A) G sol{(j{C)). It follows 
that r is a symmetry of o-(C). □ 

4.4 Symmetry and soundness 

An important property of a set of symmetry breaking constraints is 
its soundness. For a problem with symmetries E, a set of symmetry 
breaking constraints is sound iff it leaves at least one solution in each 
synmietry class. All the symmetry breaking constraints used in our 
running example are sound. The action of a symmetry on a set of 
symmetry breaking constraints leaves their soundness unchanged. 

Proposition 5 (Soundness). Given a set of symmetries E ofC, if S 
is a sound set of symmetry breaking constraints for E then o[S) for 
any cr G E w also a sound set of symmetry breaking constraints for 
E. 

Proof: Consider any A G sol{C U S) and any cr G E. Now 

A G sol{C') and A G sol{S). But as cr is a symmetry of C, 
cr(A) G sol(C). Since A G sol(S), it follows from Proposition |2] 
that cr(A) G sol{a{S)). Thus, a{A) G soZ(CUa(5')). Hence, there 
is at least one solution left by E(S') in every symmetry class of C. 
That is, cr(S) is a sound set of symmetry breaking constraints for E. 

n 



4.5 Symmetry and completeness 

A set of symmetry breaking constraints may also be complete. For a 
problem with symmetries E, a set of symmetry breaking constraints 
is complete iff it leaves at most one solution in each symmetry class. 
The action of a symmetry on a set of symmetry breaking constraints 
leaves their completeness unchanged. 

Proposition 6 (Completeness). Given a set of symmetries E of C, 
if S is a complete set of symmetry breaking constraints for E then 
cr(5) for any cr G E w also a complete set of symmetry breaking 
constraints for E. 

Proof: Consider any cr G E and A G sol{C VJ a{S)). Now A G 
sol{C) and A G sol{a{S)). But as ct is a symmetry of C, so is a~^. 
Hence a'^iA) G sol{C). Since A G sol{a{S)), it follows from 
Proposition 12 that a~^{A) G sol{S). Thus cr"^(yl) G sol{C U 5"). 
Hence, there is at most one solution left by cr{S) in every symmetry 
class of C). That is, cr(5') is a complete set of symmetry breaking 
constraints for E. □ 

4.6 Representative solutions 

Different symmetries of the symmetry breaking constraints pick out 
different solutions in each symmetry class. In fact, we can pick out 
any solution we like by choosing the appropriate symmetry of a set 
of symmetry breaking constraints. 

Proposition 7. Given a symmetry group E of a set of constraints C, 
a sound set S of symmetry breaking constraints, and any solution A 
ofC, then there is a symmetry ct G E such that A G sol{C U <j{S)). 

Proof: Since the set of symmetry breaking constraints 5 is sound, it 
leaves at least one solution (call it B) in the same symmetry class as 
A. That is, B G sol{C\JS). Hence B G sol{C) and B G sol{S). As 
A and B are in the same symmetry class, there exists a symmetry ct 
in E with A = o{B). Since B G sol{S), it follows from Proposition 
Elthat a{B) G sol{a{S)). That is, A G sol{a(S)). As B G sol{C) 
and CT G E, it follows that a{B) G sol{C). That is, A G sol{C). 
Hence A G sol{C U ct(S')). □ 

We will use this result in the second half of the paper where we 
consider the conflict between symmetry breaking constraints and 
branching heuristics. We will exploit the fact that whatever solution 
the branching heuristic is going towards, there exists a symmetry of 
the symmetry breaking constraints which does not conflict with this. 

4.7 Symmetries eliminated 

In certain cases, a set of symmetry breaking constraints completely 
eliminates a symmetry. We say that a set of symmetry breaking con- 
straints 5* breaks a symmetry ct of a problem C iff there exists a 
solution A of C U S such that o-{A) is not a solution of C U 5", and 
eliminates a symmetry ct iff for each solution A of C U 5", o-{A) is 
not a solution of C U S. Similarly, S breaks (eliminates) a set of 
symmetries E iff 5* breaks (eliminates) each ct G E. 

It is not hard to see that a sound and complete set of symmetry 
breaking constraints eliminates every non-identity symmetry. How- 
ever, there are symmetry breaking constraints which break a particu- 
lar symmetry but do not eliminate it. 

Running Example. Consider again one of the symmetry breaking 
constraints in ^: 



Xx^n < Xn,l 



(9) 



This eliminates the symmetry that reflects the magic square in its 
trailing diagonal. If we take any solution which satisfies ^, then any 
reflection of this solution in the trailing diagonal is removed by dPf. 
Note that ([9j also breaks the symmetry ergo (90° clockwise rotation) 
since (O satisfles (O but ergo of does not. However, ^ does not 
eliminate ago. For example, both (T270 of^ and ergo of this solution 
satisfy ^. A 

Applying a symmetry to a set of symmetry breaking constraints 
changes the solutions in each symmetry class accepted by the sym- 
metry breaking constraints. However, it does not change the symme- 
tries broken or eliminated by the symmetry breaking constraints. 

Proposition 8. Given a problem C with a symmetry group S, if S 
breaks (eliminates) S then o-{S) breaks (eliminates) T^for any a G 

E. 

Proof: Suppose S breaks E. Consider any symmetry r G S. Then 
there exists a solution A of C U S such that t{A) is not a solu- 
tion of C U S. As A is a solution of C and r G E, t{A) is a so- 
lution of C. Hence t{A) is not a solution of S. By Proposition [2] 
cr(r(yl)) is not a solution of <y{S). Since E is a group, it is closed 
under composition. Thus r o a o t~^ G E. Hence, as A G .sol(C), 
r^^((7(r(A))) G sol{C). Thus there is a solution of C, namely 
T~^{a{T{A))) G sol{C) such that the symmetry r of this (which 
equals cr{T{A))) is not a solution of o-{S). Hence, cy{S) breaks r. 
The proof for when S eliminates E follows similar lines. □ 

4.8 Symmetries of symmetry breaking constraints 

We have discussed the action of a symmetry on a set of symmetry 
breaking constraints. But what can we say about the symmetries of a 
set of symmetry breaking constraints? 

Proposition 9. If the symmetry breaking constraints S break the 
symmetries E in the set of constraints C then S does not have any 
symmetry in E. 

Proof: Consider any symmetry a G E. Suppose 5* has this symme- 
try. Since 5* breaks a there exists a solution A of C U S such that 
a{A) is not a solution of 5*. Hence, A is a solution of S but o-{A) is 
not. Thus, 5* does not have any symmetry in E. □ 

The reverse does not necessarily hold. There exist constraints 
which lack a symmetry which it is sound to post but which do not 
break that symmetry. 

Running Example. Consider again the most-perfect magic squares 
problem. Consider the following constraint: 



^1,1 + Xn n 



+ 1 — >■ ^1,1 < X„^n 



This does not have any variable symmetry since we cannot inter- 
change the two variables. However, this constraint does not break 
any variable symmetry since X\^\ + X„,„ 7^ n + 1 in every most- 
perfect magic square. ^ 

5 MODEL RESTARTS 

The idea that the symmetries of symmetry breaking constraints can 
themselves be used to break symmetry can be used in several differ- 
ent ways. We consider here an application of this idea for tackling the 
conflict between branching heuristics and symmetry breaking con- 
straints. Symmetry breaking picks out particular solutions in each 



symmetry class and these may not be the same solutions towards 
which branching heuristics are directing search. Heller et al. pro- 
pose using model restarts |10:| to tackle this conflict. Backtracking 
search is restarted periodically, using a new model which contains 
different symmetry breaking constraints. By posting different sym- 
metry breaking constraints, we hope at some point for the branching 
heuristic and symmetry breaking not to conflict. Heller et al. do not, 
however, provide a general method to generate different symmetry 
breaking constraints after each restart. 

Our observations that any symmetry acting on a set of symmetry 
breaking constraints can be used to break symmetry, and that differ- 
ent symmetries pick out different solutions, provide us 'iNiih precisely 
the tool we need to perform model restarts to any domain (and not 
just to the domain of interchangeable variables and values studied 
in 1101 ). When we restart search, we simply post a different sym- 
metry of the symmetry breaking constraints. We experimented with 
several possibilities. The simplest was to choose a symmetry at ran- 
dom from the symmetry group. We also tried various heuristics like 
using the symmetry most consistent or most inconsistent with pre- 
vious choices of the branching heuristic. However, we observed the 
best performance of model restarts with a random choice of symme- 
try so we only report results here with such a choice. This is also 
algorithmically simple since computer algebra packages like GAP 
provide efficient algorithms for computing a random element of a 
group given a set of generators for the group. 

Running Example. We consider the simple problem of finding a 
magic square of order 5. The following table gives the amount of 
search needed to find such a magic square when posting one of the 
rotational symmetries of the symmetry breaking constraints and the 
default branching heuristic that labels variables in a fixed order. We 
encoded the problem in BProlog running on a Pentium 4 3.2 GHz 
processor with 3GB of memory. With magic squares in general, we 
cannot guarantee that the inverse of the smallest corner is not itself a 
corner value. We therefore relax the strict inequality in ^, replacing 
it by a non-strict inequality. 



Symmetry posted 


Backtracks 


Time to solve/s 


of lU and ^ 
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0.02 


O"90 


17,143 


0.36 


O"180 


315,267 


5.60 


O"270 


18,808,974 


408.85 



We see that the different symmetries of the symmetry breaking 
constraints interact differently with the branching heuristic. Model 
restarts will help overcome this conflict. Suppose we restart search 
every 1,000 backtracks and choose to post at random one of these 
symmetries of^ and ^. Let t be the average number of branches 
to find a solution. There is i chance that the first restart will post 
Oid o/0 and |6]). In this situation, we find a solution after 658 back- 
tracks. Otherwise we post one of the other symmetries o/([5j and ([6j. 
We then explore 1,000 backtracks, reach the cutoff and fail to find a 
solution. As each restart is independent, we restart and explore on 
average another t more branches. Hence: 

t = i658+T(1000 + t) 
4 4 

Solving fi>r t gives t — 3, 658. Thus, using model restarts, we take 

just 3,658 backtracks on average to solve the problem. Jft 

Note that posting random symmetries of the symmetry breaking 
constraints is not equivalent to fixing the symmetry breaking and ran- 
domly branching. Different symmetries of the symmetry breaking 



constraints interact in different ways with the problem constraints. 
Although the problem constraints are themselves initially symmetri- 
cal, branching decisions quickly break the symmetries that they have. 

6 EXPERIMENTAL RESULTS 

Our experiments are designed to test two hypotheses. The first hy- 
pothesis is that model restarts is less sensitive to branching heuristics 
than posting static symmetry breaking constraints. We test this hy- 
pothesis by using either a lexicographic value ordering (which does 
not conflict with the symmetry breaking constraints) or random value 
ordering, while using min-domain for variable ordering. We expect 
that model restarts will show smaller variation between the two value 
ordering heuristics. The second hypothesis is that model restarts will 
often explore a smaller search tree than dynamic methods like SBDS 
due to propagation of the symmetry breaking constraints. We tested 
two domains that exhibit two different kinds of symmetry: partial 
variable and value interchangability, and row and column symmetry. 

We limit our comparison of dynamic methods to SBDS. Whilst 
there is a specialized dynamic symmetry breaking method for inter- 
changeable variables and values, experiments in 1101 show that this 
is several orders of magnitude slower than static methods. We also 
do not compare to methods such as GE-trees 1 17], as this method is 
limited to value symmetry and does not deal with the variable/value 
symmetries in our domains. Finally, we used SBDS to break just gen- 
erators of the symmetry group as breaking the full symmetry group 
quickly exhausted available memory. We implemented model restarts 
and SBDS as well as all the static symmetry breaking constraints in 
Gecode 2.2.0, and ran all experiments on a 4-core Intel Xeon 5130 
with 4MB of L2 cache running at 2GHz. 

The first set of experiments uses random graph coloring problems 
generated in the same way as the previous experimental study in 1 13 1. 
All values in this model are interchangeable. In addition, we intro- 
duce variable symmetry by partitioning variables into interchange- 
able sets of size at most 8. We randomly connect the vertices within 
each partition with either a complete graph or an empty graph, and 
choose each option with equal probability. Similarly, between any 
two partitions there is equal probability that the partitions are com- 
pletely connected or independent. Results for graphs with 40 vertices 
are shown in Table 1 . 

The second set of experiments uses Equidistant Frequency Permu- 
tation Array (EFPA) problem 111]. Given the parameters v,q,X, d, 
the objective is to find v codewords of length gA, such that each word 
contains exactly A occurences of each of q symbols and each pair of 
words have Hamming distance d. Our model has both row and col- 
umn symmetry. We implement model restarts by randomly choosing 
a permutation of the rows and columns and posting lexicographic 
ordering constraints on the rows and columns of the resulting matrix. 

The results support both our hypotheses. Although the model 
restarts method is not necessarily the best method for any given in- 
stance, its performance is most robust. The variability of the run- 
times between the lex value ordering and random value ordering is 
much smaller for model restarts, as well as for SBDS. This suggests 
that in domains where the branching heuristic interacts more strongly 
with the problem constraints, model restarts will be more robust than 
static symmetry breaking constraints. Our second hypothesis, that 
model restarting tends to explore a smaller search tree than SBDS 
is also supported by the graph coloring results. SBDS was unable to 
prove optimality in all but one instance in graph coloring. These re- 
sults confirm the findings of 1 10|. In EFPA on the other hand, there 
are enough solutions in these instances that applying little symmetry 



breaking with a random value ordering seems to be the best strat- 
egy. However, on the harder instances such as 4-6-4-5, using model 
restarts resolves the conflict between the branching heuristic and the 
symmetry breaking constraints and achieves parity with SBDS. 

7 OTHER RELATED WORK 

Crawford et al. proposed a general method to break symmetry stati- 
cally using lex-leader constraints fT\. Like other static methods, the 
posted constraints pick out in advance a particular solution in each 
symmetry class. Unfortunately, this may conflict with the solution 
sought by the branching heuristic. There are a number of symme- 
try breaking methods proposed to deal with this conflict. For exam- 
ple, dynamic symmetry breaking methods like SBDS posts symme- 
try breaking constraints dynamically during search [7J. Another dy- 
namic method for breaking symmetry is SBDD (3|. This checks if 
a node of the search tree is symmetric to some previously explored 
node. A weakness of such dynamic methods is that we get little or no 
propagation on the symmetry breaking constraints. It has been shown 
that propagation between the problem constraints and the static sym- 
metry breaking constraints can reduce search exponentially 1201 . 

Jefferson et al, have proposed GAPLex, a hybrid method that com- 
bines together static and dynamic symmetry breaking [ 12 1. However, 
GAPLex is limited to dynamically posting lexicographical ordering 
constraints, and to searching with a fixed variable ordering. Puget has 
proposed "Dynamic Lex", a hybrid method that dynamically posts 
static symmetry breaking constraints during search which works with 
dynamic variable ordering heuristics 1 16|. This method adds symme- 
try breaking constraints dynamically during search that are compat- 
ible with the current partial assignment. In this way, the first solu- 
tion found during tree search is not removed by symmetry breaking. 
Dynamic Lex needs to compute the stabilizers of the current partial 
assignment. This requires a graph isomorphism problem to be solved 
at each node of the search tree. Whilst Dynamic Lex works with dy- 
namic variable ordering heuristics, it assumes that values are tried 
in order. Finally Dynamic Lex is limited to posting lexicographical 
ordering constraints. A comparison with Dynamic Lex is interest- 
ing but challenging. For instance. Heller et al. 1 101 did not compare 
model restarts with Dynamic Lex, arguing: 

"It is not clear how this method [Dynamic Lex] can be gener- 
alized, though, and for the case of piecewise variable and value 
symmetry, no method with similar properties is known yet." 

8 CONCLUSIONS 

We have considered the action of symmetry on symmetry breaking 
constraints. We proved that any symmetry applied to a set of sym- 
metry breaking constraints gives a (possibly new) set of symmetry 
breaking constraints that break the same symmetries. In addition, we 
proved that different symmetries of the set of symmetry breaking 
constraints will pick out different solutions in each symmetry class. 
We used these observations to help tackle the conflict between sym- 
metry breaking and branching heuristics. In particular, we applied 
these ideas to model restarts \ 10|. In this search technique, we pe- 
riodically restart search with a new model which contains a random 
symmetry of the symmetry breaking constraints. Experimental re- 
sults show that this helps keep many of the benefits of posting static 
symmetry breaking constraints whilst reducing the conflict between 
symmetry breaking and the branching heuristic. There are other po- 
tential applications of these ideas. For example, we are currently de- 
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Table 1. Static symmetry breaking constraints vs Model restarts and SBDS on Grapii Coloring problems, "opt" is the quality of the solution found (* indicates 
optimality was not proved), "t" is the runtime in seconds, "b" is the number of backtracks. The best method for a problem instance is in bold font. 
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Table 2. Static symmetry breaking constraints vs Model restarts and SBDS on EFPA problems, "t" is the runtime in seconds, "b" is the number of backtracks. 
The best method for a problem instance is in bold font. 



veloping methods for dynamically posting a symmetry of the sym- 
metry breaking constraints which does not conflict with the branch- 
ing heuristic. In the longer term, we would like to exploit symmetries 
of the nogoods learnt during search. Nogoods are themselves just 
constraints. We can therefore consider symmetries acting on them. 
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